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Continued Examination Under 37 CFR 1, 1 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
03/23/2006 has been entered. 

Response to Amendment/Arguments 

2. This action is in response to amendment filed 03/23/06, which has been entered. 

3. Claims 5, 7, 13, 16, 17, 19, 22-24 and 26 have been cancelled; claims 32 and 33 
have been added. Claims 1-4,6,8-12,14, 15, 18, 20, 21, 25 and 27-33 are still pending. 

4. Applicant's arguments filed 03/23/06 have been fully considered but they are not 
persuasive; see below. 

5. In remarks Applicant argues in substance: 
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5.1 (Re claims 1, 8, 15 and 21) (a) that none of the cited references disclose that the 
entire image is enhanced (P. 10, 3^^ paragraph, P. 11, 3^^ paragraph and P. 12, 
2"^ paragraph) and (b) that Fowler does not disclose that the entire lofargram 
image is enhanced based on any of the individual strips (P. 12, 2"^ paragraph, 
lines 1-2) 

Regarding (a), in response to applicant's argument that the references fail to 
show certain features of applicant's invention, it is noted that the feature upon 
which applicant relies (i.e., the entire image being enhanced) is not recited in the 
rejected claim(s). Although the claims are interpreted in light of the specification, 
limitations from the specification are not read into the claims. See In re Van 
Geuns. 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

In any event, as per the analysis in the rejection of claim 1 , Fowler does disclose 
enhancing each and every segment of an image (i.e., the entire image); in the 
case of an image containing one or more faces, the facial and non-facial regions 
are considered as separate segments and therefore Fowler certainly suggests 
enhancing the entire image. 

Regarding (b), note that enhancing the entire image basing on one individual 
segment (e.g., a facial region or a strip) is not a limitation of the claim, either. 
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5.2 (Re claims 15 and 21) that none of the cited references disclose that the target 
levels for a mean value or a variation value are desired lightness and contrast 
levels as determined through a determination of human visual preferences (P. 
12, last paragraph, lines 1-3) and therefore would not appear to benefit from such 
enhancement as claimed in claims 15 and 21 (P. 13, lines 3-5) 

However, Kato does disclose that the pixel values that are to be enhanced to 
achieve target levels for a mean are lightness values [Fig. 14, ref. 16 and Col. 7, 
lines 44-46]. Note also that when lightness is adjusted, contrast may change 
accordingly. In any event, per the analysis in the rejection of claims 30 and 31 , 
Fowler also discloses adjusting the pixel values to achieve a desired variance 
value, which results in a different contrast. 

Since the aim of redeye reduction disclosed in Schildkraut is to make the image 
more appealing, further enhancement by mapping the pixel values of the image 
to obtain desirable target levels for a mean value or a variation value (well known 
in the art as admitted in lines 13-18 on page 5 of the specification) obviously can 
benefit Schildkraut's invention by further enhancing the images. 

5.3 (Re claims 1, 8, 15 and 21) (a) that no evidence was provided that the proposed 
combination would result in the advantage described in P. 13, last paragraph, 
lines 1-4 (attributed to the Office action mailed 12/23/05) and (b) that the three 
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cited references are so drastically different that there is no clear indication as to 
what the proposed combination would yield (P. 13, last two lines) 



Regarding (a), the Office action recites no such advantage as part of the 
motivation to combine in the rejection of claims 1, 8, 15 and 21. 



Regarding (b), in response to applicant's argument that the three cited references 
are nonanalogous art, it has been held that a prior art reference must either be in 
the field of applicant's endeavor or, if not, then be reasonably pertinent to the 
particular problem with which the applicant was concerned, in order to be relied 
upon as a basis for rejection of the claimed invention. See In re Oetiken 977 
F.2d 1443. 24 USPQ2d 1443 (Fed. Cir. 1992). In this case, the three references 
are all from the same field of endeavor of image enhancement and the specific 
enhancing techniques disclosed in Kato and Fowler can be added to Schildkraut 
to obtain the invention as specified in the claims, namely, using Kato's teaching 
to automatically enhance the brightness and further using Fowler's teaching to 
obtain a target mean brightness level in the facial region. 
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Claim Rejections - 35 USC § 103 



6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 



7. Claims 1,2, 8, 10, 15, 21 and 27-33 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Schildkraut et al. (US 6,292,574), in view of Kado et al. (US 
6,181,806) and Fowler (US 5,410,618). 



8. Regarding claim 1, and similarly claims 8, 15 and 21, Schildkraut discloses: 

• automatically detecting one or more human faces in an image using face 
detection algorithms and automatically locating the one or more human 
faces in the image 

[Fig. 2, numeral SIO; Fig. 6; Col. 4, line 13-Col. 5, line4] 



Schildkraut does not expressly disclose 

• automatically enhancing an appearance of the image by using a mapping 
technique to produce the image with target levels for a mean value or a 
variation value of the pixels in the one or more human faces 



However, Kado discloses automatically measuring brightness (i.e., lightness levels) of 
human faces [Fig, 14, ref. 16 and col. 7, lines 33-36] and automatically enhances the 
image's brightness based on the measure brightness [col. 7, lines 44-46]. In addition, 
Fowler discloses linear mean invariant transforms (i.e., a mappings) that enhance 
general images in such a way that the resultant image has a target mean [Col. 1, lines 
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30-40]. Fowler further discloses a mapping technique specifically designed for 
lofargram images [Fig. 1, refs. 3-7; Col. 3, lines 15-30; Col. 6, line 48-Col. 7, line 5. 
Note that an example of a lofargram image can be found in the first slide of the 
presentation made by Vincent Premus in the 7*^ Annual ASAP '99 Workshop.] 

Schildkraut, Kado and Fowler are combinable because they all have aspects that are 
from the same field of endeavor of image enhancement (note that red eye correction is 
a form of image enhancement). 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify Schildkraut with the teachings of Kado and Fowler to enhance detected 
human faces by using a mapping technique. The motivation would have been to 
improve visual quality, among other things, as Fowler indicated in [Col, 1, lines 11-20 
and Col. 2, lines 28-35]. In addition, as the purpose of red eye correction is to provide 
an facial image with a better visual quality, it would have been obvious to go one step 
further by enhancing the overall visual quality of the faces (and not just the eyes) in the 
image since doing so would provide even better results to the clients (e.g., by a photo- 
processing lab to its customers). 

Therefore, it would have been obvious to combine Kado and Fowler with Schildkraut to 
obtain the invention as specified in claim 1. 
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9. Regarding claim 2, and similarly claim 10, Kado further discloses 

• wherein the module for enhancing the appearances of the image includes a 
module for automatically enhancing lightness levels of the images to 
enhance the appearance of the one or more human faces 

[Fig. 14, ref. 16 and col. 7, lines 44-46] 

10. Regarding claim 27, and similarly claims 28 and 29, Schildkraut further discloses 

• automatically locating eyes in the human faces 
[Fig. 2, numerals S16-S30; Figs. 9, 11] 

1 1 . Regarding claims 30 and 31 , Fowler further discloses mapping using the recited 
equations. [Col. 6, line 48-Col. 7, line 5. Note that Eq. 13 is a more general mapping 
function that includes both scaling and offsetting. When only offsetting is performed, 
i.e., A = 1, Eq. 13 becomes P + B (note that in line 1 of col. 7 "w" should have been "u"). 
On the other hand, when only scaling is performed, i.e., B = 0, Eq. 13 becomes 

AP + (1-A)u. Note further that B is the difference of the new and the original means and 
A is the square root of the ration of the new and the original variants, per Eqs. 1 1 and 
12 in col. 6] 

12. Regarding claims 32 and 33, note that as admitted in page 5, lines 13-18 of the 
specification, determining the target levels through a determination of human visual 
preferences is well known in the art and would obviously have been considered by one 
of ordinarily skill in the art since facial images, especially photographs, are typically 
viewed by humans. 
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13. Claims 3, 4, 1 1, 12 and 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Schildkraut et al. (US 6,292,574), Kado et al. (US 6,181,806) and 
Fowler (US 5,410,618) as applied to claims 1, 2, 8, 10. 15, 21 and 27-33 above, further 
in view of Center, Jr. et al. (US 6,680,745). 

Regarding claims 3 and 4, and similarly claims 11,12 and 18, the combined invention of 
Schildkraut, Kado and Fowler discloses everything except the following, which Center 
teaches: 

• wherein the module for enhancing the appearances of the image includes a 
module for automatically enhancing contrast levels (claim 3) or color 
levels (claim 4) of the images to enhance the appearance of the one or 
more human faces 

[Fig. 1; col. 2, lines 55-60. Note that while Center discloses 
adjusting the camera's settings, one of ordinary skill in the art would 
have recognized that such changes can be achieved by image processing 
means; see, for example, the analysis of claim 2 above in which Kado is 
relied upon for enhancing brightness] 

The combined invention of Schildkraut, Kado and Fowler is combinable with Center 
because they have aspects that are from the same field of endeavor efface detection. 

Therefore, at the time of the invention it would have been obvious to one of ordinary skill 
in the art to modify the combined invention of Schildkraut, Kado and Fowler with the 
teaching of Center by enhancing an appearance of the image by changing the contrast 
and/or color (in addition to changing brightness as Kado disclosed). The motivation 
would have been to obtain better images, as Center indicated in column 2, lines 55-60. 
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Therefore, it would have been obvious to combine Center with Schildl<raut, Kado and 
Fowler to obtain the inventions as specified in claims 3 and 4, respectively. 

14. Claims 6, 14, 20 and 25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Schildkraut et al. (US 6.292,574), Kado et al. (US 6,181,806) and 
Fowler (US 5,410,618) as applied to claims 1, 2, 8, 10, 15, 21 and 27-33 above, further 
in view of Acker et al. (US 6,009,209). 

Regarding claim 6, and similarly claims 14, 20 and 25, the combined invention of 
Schildkraut, Kado and Fowler discloses all limitations except the following, which Acker 
et al. teaches: 

• reducing or removing the 'red eye artifact from the human faces 
[Fig. 5, numeral 109; Fig. 9, numeral 504; Fig. 11; Fig. 13] 

The combined invention of Schildkraut, Kado and Fowler is combinable with Acker 
because they have aspects that are from the same field of endeavor of red eye 
detection. 

Therefore, at the time of the invention it would have been obvious to one of ordinary skill 
in the art to modify the combined invention of Schildkraut, Kado and Fowler with the 
teaching of Acker et al, by detecting and removing red-eye effects from the image. The 
motivation would have been to remove the unpleasant appearance of red-eye defects in 
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an image of a person's face caused by, e.g., a flash when the image was taken in order 
to produce a more natural-looking face. 

Therefore, it would have been obvious to combine Acker et al. with Schildkraut, Kado 
and Fowler to obtain the invention as specified in claim 6. 

Conclusion and Contact Information 

15. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

• Kim et al. (US 5,862,254) - discloses adjusting image brightness to achieve a 
pre-determined mean brightness level 

• Lee et al. (US 5,822,453) - discloses adjusting image pixel values to achieve a 
desired contrast level 

16. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Yubin Hung whose telephone number is (571) 272- 
7451 . The examiner can normally be reached on 7:30 - 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on (571) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Yubin Hung 
Patent Examiner 
April 26, 2006 




